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TO ALL WHOM IT MAY CONCERN: 

Be it known that We, Mohammad R. Haghighat, a citizen of Iran, 
residing at 5685 Mireille Drive, San Jose, California 951 18; and David C. Sehr, a citizen 
of United States, residing at 21578 Flintshire St., Cupertino, California 95014 have 
invented a new and useful METHODS AND APPARATUS TO MINIMIZE 
DEBUGGING AND TESTING TIME OF APPLICATIONS, of which the following 
is a specification. 
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METHODS AND APPARATUS TO MINIMIZE DEBUGGING AND TESTING 

TIME OF APPLICATIONS 

TECHNICAL FIELD 
[0001] The present disclosure relates generally to software debugging and testing, and 
more particularly, to methods and apparatus to minimize debugging and testing time of 
applications. 

BACKGROUND 

[0002] A significant amount of time and/or man power is spent on debugging and 
testing for defects in applications. Typically, a debugging process is built into the 
development, testing, and validation of an application to isolate errors in the application. 
In particular, the debugging program may include a number of tests to determine a 
starting breakpoint to identify an error (i.e., a "bug"). However, it may not be known 
which one of the tests that reaches the starting brealq)oint faster than the other tests. As a 
result, a significant amoxmt of time and/or man-power, especially in the case of long- 
running applications, may be required to identify those tests that minimize the amount of 
application debugging and testing time. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0003] FIG. 1 is a block diagram representation of an example application debugging 
and testing time minimizing system constructed in accordance with the teachings the 
invention. 

[0004] FIG. 2 is a block diagram representation of output data of the example system 
shown in FIG. 1 . 
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[0005] FIG- 3 is a flow diagram representation of one manner in which the example 
system of FIG. 1 may be configured to minimize debugging and testing time of 
applications. 

[0006] FIG. 4 is a code representation of an example probe that may be used to 
implement the example system shown in FIG. 1 . 

[0007] FIG. 5 is a code representation of an example data analyzing device that may 
be used to implement the example system shown in FIG. 1. 

[0008] FIG. 6 is a block diagram representation of an example processor system that 
may be used to implement the example system shown in FIG. 1. 

DETAILED DESCRIPTION 
[0009] Although the following discloses example systems including, among other 
components, software or firmware executed on hardware, it should be noted that such 
systems are merely illustrative and should not be considered as limiting. For example, it 
is contemplated that any or all of the disclosed hardware, software, and/or firmware 
components could be embodied exclusively in hardware, exclusively in software, 
exclusively in firmware or in some combination of hardware, software, and/or firmware. 
[0010] In the examples of FIGS. 1 and 2, the illustrated application debugging and 
testing time minimizing system 100 includes an application source 1 10, a code coverage 
device 120, a debugging and testing device 130, a test coverage database 140, a data 
analyzing device 150, and a test identifying device 160. In general, an instrumented code 
of an application is generated and a plurality of tests is executed on the instrumented code 
of the application. One or more test profiles associated with the plurality of tests are 
generated. Further, at least one of the plurality of tests is identified (i.e., selected and 
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prioritized) based on the test profiles to minimize debugging and testing time of the 
application. 

[0011] The application source 1 10 provides the code of an application 210 to the code 
coverage device 120. As used herein the term "application" refers to one or more 
methods, functions, routines, or subroutines for manipulating data. Persons of ordinary 
skill in the art will readily recognize that the code coverage device 120 is configured to 
identify portions of a particular application that did not execute dxmng runtime of that 
application. Accordingly, the code coverage device 120 is configured to insert one or 
more probes 220 into the code of the application 210. For example, the probes 220 may 
be inserted at entries of a basic block into the code of the application 210. Each of the 
probes 220 is configured to identify one or more program states of interest to a user (e.g., 
a software developer or a programmer). For example, program states of interest may 
include a particular logical state (e.g., x = y, a true condition, etc.). The code coverage 
device 120 may be a compiler, an assembler, an interpreter, a post-link optimizer, a just- 
in-time (JIT) compiler, and/or any suitable mechanism to instrument the code of the 
application 210 (i.e., to insert one or more probes 220 into the code of the application 
210). 

[0012] Each of the probes 220 is configured to generate a time stamp representative 
of the time at which a particular program or application state is first identified at the 
location in the code of the application 210 where that particular probe 220 is inserted. 
For example, the time stamp may be generated by a processor (e.g., the processor 1020 of 
FIG. 6) based on a hardware timer. The. time stamp may also be generated by an 
application program interface (API) specified by an operating system (OS). In another 
example, the time stamp may be generated by using a shared global variable across all 
threads of the application to simulate a virtual timer. The shared global variable is 
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initialized to zero and dynamically incremented by one when the probe 220 is executed. 
Accordingly, the code coverage device 120 generates an instrumented code of the 
application 230 (i.e., the code of the application 210 including the probes 220). 
[0013] The debugging and testing device 1 30 includes a plurality of tests 240, 
generally shown as 132, 134, 136, and 138. Persons of ordinary skill in the art will 
appreciate that the plurality of tests 240 may be used to debug the code of the application 
210. The debugging and testing device 130 is configured to run the instrumented code of 
the application 230 and to use the plurality of tests 240 to generate one or more test 
profiles 250. Each of the test profiles 250 corresponds to one of the plurality of tests 240. 
For example, the debugging and testing device 130 may generate a test profile 
corresponding to each of Test 1 (block 132), Test 2 (block 134), Test 3 (block 136), 
and/or Test n (block 138). In particular, each of the test profiles 250 includes information 
associated with the corresponding test (i.e., one of the plurality of tests 240). In 
particular, each of the test profiles 250 may include a time stamp generated by one of the 
probes 220 as described above. For example, the time stamp may correspond to the first 
time a particular program state is identified. 

[0014] The test coverage database 140 is configured to store the test profiles 250 
associated with the plurality of tests 240. The test coverage database 140 may be stored 
in a memory device such as a volatile memory device, a non- volatile memory device, 
and/or a mass storage device. The data analyzing device 150 is configured to access and 
process the test profiles 250 stored in the test coverage database 140. In particular, the 
data analyzing device 150 may organize the test profiles 250 so that the plurality of tests 
240 may be identified as described in detail below. 

[0015] The test identifying device 1 60 is configured to identify one or more of the 
plurality of tests 240. In particular, a test selecting device 170 identifies at least one of 
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the plurality of tests 240 based on the analysis of the test profiles 250 by the data 
analyzing device 150 in response to queries 260 regarding the application made by the 
user via a user input device 190 (e.g., a keyboard, a mouse, a voice recognition system, 
etc.). For example, a user (e.g., a software developer and/or a programmer) may inquire 
about which one of the plurality of tests 240 most quickly reaches a breakpoint in the 
code of the application 210. Accordingly, a test prioritizing device 180 is configured to 
generate a prioritized list of tests 270 based on the at least one of the plurality of tests 240 
identified by the test selecting device 1 70. In this manner, the debugging and testing time 
of the application is minimized by selecting an appropriate group of tests fi'om the 
plurality of tests 240 to execute on the application rather than executing all of the 
plurality of tests 240. 

[0016] While the components shown in FIG. 1 are depicted as separate blocks within 
the application debugging and testing time minimizing system 100, the functions 
performed by some or all of these blocks may be integrated within a single semiconductor 
circuit or may be implemented using two or more separate integrated circuits or software 
components. For example, although the application source 110 and the code coverage 
device 120 are depicted as separate blocks, persons of ordinary skill in the art will readily 
appreciate that the application source 110 and the code coverage device 120 may be 
integrated into a single block. In another example, although the test selecting device 170 
and flie test prioritizing device 180 are depicted as separate blocks within the test 
identifying device 160, persons of ordinary skill in the art will readily appreciate that the 
test selecting device 170 and the test prioritizing device 180 may be integrated into a 
single block or structure. 

[0017] A flow diagram 300 representing one manner in which the application 
debugging and testing time minimizing system 100 of FIG. 1 may be configured to 
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minimize debugging and testing time of applications is illustrated in FIG. 3. Persons of 
ordinary skill in the art will appreciate that the flow diagram 300 of FIG. 3 may be 
implemented using machine readable instructions that are executed by a processor. In 
particular, the instmctions may be implemented in any of many different ways utilizing 
any of many different progranmiing codes stored on any of many computer-readable 
mediums such as a volatile or nonvolatile memory or other mass storage device (e.g., a 
floppy disk, a CD, and a DVD). For example, the machine readable instructions may be 
embodied in a machine-readable medium such as an erasable programmable read only 
memory (EPROM), a read only memory (ROM), a random access memory (RAM), a 
magnetic media, an optical media, and/or any other suitable type of medium. 
Alternatively, the machine readable instructions may be embodied in a programmable 
gate array and/or an application specific integrated circuit (ASIC). Further, although a 
particular order of actions is illustrated in FIG. 3, persons of ordinary skill in the art will 
appreciate that these actions can be performed in other temporal sequences. Again, the 
flow diagram 300 is merely provided as an example of one way to minimize debugging 
and testing time of applications. 

[0018] The flow diagram 300 begins with the code coverage device 120 generating 
the instrumented code of the application 230 firom the code of the application 210 (block 
310). In particular, the code coverage device 120 inserts one or more probes 220 into the 
code of the application 210 to generate the instrumented code of the application 230. The 
debugging and testing device 130 executes a plurality of tests 240 on the instrumented 
code of the application 230 (block 220). When the plurality of tests 240 is executed, the 
probes 220 in the instrumented code of the application 230 are configured to identify one 
or more program states of the application. In the example of FIG. 4, the illustrated probe 
400 is configured to identify program states of interest such as a particular logical state 
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(e.g., X = y, a true condition, etc.), generally shown as 410, 420, and 430. Further, the 
probe 400 (e.g., via a timer 440) is configured to generate one or more time stamps 
corresponding to each of the one or more program states. The time stamps are based on a 
timer 440, which may be a hardware timer, a software timer, and/or a virtual timer. 
[0019] Referring back to FIG. 3, the debugging and testing device 130 generates one 
or more test profiles 250 associated with the plurality of tests 240 (block 330). Each of 
the test profiles 250 includes test information of at least one of the plurality of tests 240. 
For example, each of the test profiles 250 may include at least one time stamp 
corresponding to one or more program states of the application. 

[0020] The debugging and testing device 130 stores the one or more test profiles 250 
in the test coverage database 140 (block 340), and the data analyzing device 150 may 
access the test coverage database 140 to analyze the one or more test profiles 250 (block 
350). In particular, the data analyzing device 1 50 may identify a particular time stamp 
indicating the earliest time at which the program state is reached in ttie application. For 
example, the data analyzing device 150 may be implemented by the code shown in FIG. 
5. Thus, that particular time stamp may indicate the first time that particular program 
state is identified when the application is executed. 

[0021] Based on the one or more test profiles 250 in the test coverage database 140, 
the test identifying device 160 (via the test selecting device 170) identifies at least one of 
the plurality of tests to test the application (block 360). In response to a user query via 
the user input device 190, the test selecting device 170 may identify at least one of the 
plurality of tests 240 based on the test profiles 250. For example, a user may inquire 
about which one of the plurality tests 240 causes the application to most quickly reach a 
particular breakpoint in a particular situation. Altematively, the debug query by the user 
may be pre-programmed. Accordingly, the test prioritizing device 180 generates a 
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prioritized list of tests from the at least one of the plurality of tests 240 identified by the 
test selecting device 170 to minimize the total amount of time to test the application 
(block 370). As a result, development cost of the application may be reduced because it 
is not necessary to run all of the plurality of tests 240 to test the code of the application 
210. 

[0022] FIG. 6 is a block diagram of an example processor system 1 000 adapted to 
implement the methods and apparatus disclosed herein. The processor system 1000 may 
be a desktop computer, a laptop computer, a notebook computer, a personal digital 
eissistant (PDA), a server, an Intemet appliance or any other type of computing device. 
[0023] The processor system 1000 illustrated in FIG. 6 includes a chipset 1010, which 
includes a memory controller 1012 and an input/output (I/O) controller 1014. As is well 
known, a chipset typically provides memory and I/O management functions, as well as a 
plurality of general purpose and/or special purpose registers, timers, etc. that are 
accessible or used by a processor 1020. The processor 1020 is implemented using one or 
more processors. For example, the processor 1020 may be implemented using one or 
more of the Intel® Pentium® family of microprocessors, the Intel® Itanium® family of 
microprocessors, Intel® Centrino® family of microprocessors, and/or the Intel XScale® 
family of processors. In the altemative, other processors or families of processors may be 
used to implement the processor 1020. The processor 1020 includes a cache 1022, which 
may be implemented using a first-level xmified cache (LI), a second-level imified cache 
(L2), a third-level unified cache (L3), and/or any other suitable structures to store data as 
persons of ordinary skill in the art will readily recognize. 

[0024] As is conventional, the memory controller 1012 performs functions that enable 
the processor 1020 to access and conmnmicate with a main memory 1030 including a 
volatile memory 1032 and a non- volatile memory 1034 via a bus 1040. The volatile 
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memory 1032 may be implemented by Synchronous Dynamic Random Access Memory 
(SDRAM), Dynamic Random Access Memory (DRAM), RAMBUS Dynamic Random 
Access Memory (RDRAM), and/or any other type of random access memory device. The 
non- volatile memory 1034 may be implemented using flash memory. Read Only Memory 
(ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), and/or any 
other desired type of memory device. 

[0025] The processor system 1000 also includes an interface circuit 1050 that is 
coupled to the bus 1040. The interface circuit 1050 may be implemented using any type 
of well known interface standard such as an Ethemet interface, a universal serial bus 
(USB), a third generation input/output interface (3GIO) interface, and/or any other 
suitable type of interface. 

[0026] One or more input devices 1060 are connected to the interface circuit 1050. 
The input device(s) 1060 permit a user to enter data and commands into the processor 
1020. For example, the input device(s) 1060 may be implemented by a keyboard, a 
mouse, a touch-sensitive display, a track pad, a track ball, an isopoint, and/or a voice 
recognition system. 

[0027] One or more output devices 1070 are also connected to the interface circuit 
1050. For example, the output device(s) 1070 may be implemented by display devices 
(e.g., a light emitting display (LED), a liquid crystal display (LCD), a cathode ray tube 
(CRT) display, a printer and/or speakers). The interface circuit 1050, thus, typically 
includes, among other things, a graphics driver card. 

[0028] The processor system 1000 also includes one or more mass storage devices 
1080 configured to store software and data. Examples of such mass storage device(s) 
1080 include floppy disks and drives, hard disk drives, compact disks and drives, and 
digital versatile disks (DVD) and drives. 
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[0029] The interface circuit 1050 also includes a communication device such as a 
modem or a network interface card to faciHtate exchange of data with extemal computers 
via a network. The communication link between the processor system 1000 and the 
network may be any type of network connection such as an Ethemet connection, a digital 
subscriber line (DSL), a telephone line, a cellular telephone system, a coaxial cable, etc. 
[0030] Access to the input device(s) 1060, the output device(s) 1070, the mass storage 
device(s) 1080 and/or the network is typically controlled by the I/O controller 1014 in a 
conventional manner. In particular, the I/O controller 1014 performs functions that 
enable the processor 1020 to communicate with the input device(s) 1060, the output 
device(s) 1070, the mass storage device(s) 1080 and/or the network via the bus 1040 and 
the interface circuit 1050. 

[0031] While the components shown in FIG. 6 are depicted as separate blocks within 
the processor system 1000, the functions performed by some of these blocks may be 
integrated within a single semiconductor circuit or may be implemented using two or 
more separate integrated circuits. For example, although the memory controller 1012 and 
the I/O controller 1014 are depicted as separate blocks within the chipset 1010, persons of 
ordinary skill in the art will readily appreciate that the memory controller 1012 and the 
I/O controller 1014 may be integrated within a single semiconductor circuit. 
[0032] Although certain example methods, apparatus, and articles of manufacture 
have been described herein, the scope of coverage of this patent is not limited thereto. On 
the contrary, this patent covers all methods, apparatus, and articles of manufacture fairly 
falling within the scope of the appended claims either literally or under the doctrine of 
equivalents. 
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